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(57) Abstract 



A method and device for improving DFE performance in a trellis coded system by placing a short adaptive predictive filter after the 
DFE in order to whiten the error sequence at the output of the DFE 
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Method and device for improving DFE performance in a trellis-coded system. 



BACKGROUND OF THE INVENTION 
1. Field of the Invention 

The present invention is directed in general to digital signal processing, and in 
particular to receiver based methods and devices for improving decision feedback equalizer 
5 ("DFE") performance in a trellis coded system. 



2. Background of the Invention 

In many digital communication scenarios (e.g. telephone transmission, 
broadcast TV transmission, cable etc.) The transmitted signal arrives at the receiver through 

10 more than one path in addition to the direct path. This condition is called "multipatlT and 

leads to intersymbol interference ("ISI") in the digital symbol stream. This ISI is compensated 
for in the receiver through an equalizer which in many cases is a DFE as shown in Fig. 1. U.S. 
Patent No.5,572,262 shows one method of combating these multipaths. 

A DFE 10 (Fig. 1) has two filter sections, a forward filter 12 and a feedback 

15 filter 1 6. The input to the forward filter 12 is the received data which includes the transmitted 
symbol sequence a*, noise nk and multipath hi. The input to the feedback filter 16 is the 
quantized equalizer output &k. The output of both the sections are summed 1 8 to form the final 
equalizer output a k which is also the input to the next stage in a trellis-coded system, the trellis 
decoder. While a DFE performs better than a linear equalizer in severe ISI, the performance is 

20 limited by error propagation through the feedback filter 16 of the DFE 10. Error propagation 
occurs in the feedback filter 16 when the quantized equalizer output a* is not the same as the 
transmitted symbol ak. If an error is made in determining the symbol &k at the output of the 
slicer 11, this incorrect symbol is fed back to the input of the feedback filter 16 and 
propagates. In many systems which employ error correction codes like trellis codes and/or 

25 Reed-Solomon codes to obtain very low error rates at moderate SNRs, the "raw" symbol error 
rate (SER) at the equalizer output can be extremely high. For example, in the VSB system, at 
threshold in white noise the SER at the equalizer output is about 0.2. The increased error 
propagation due to these high SERs can cause the DFE to lose a couple of dB in performance 
as compared to the case of no error propagation. Additionally, the error propagation causes 




WOOO/01085 PCT/IB99/01087 

2 

the error sequence at the equalizer output to be correlated, since it depends on past incorrect 
symbol decisions. This correlation has an adverse effect on the subsequent trellis decoder 
which is usually designed for a white noise sequence. 

5 SUMMARY OF THE INVENTION 

Accordingly, it is an object of the invention to reduce the mean-squared-error 
(MSE) and correlation of the DFE output error sequence. This object is achieved by placing a 
short adaptive predictor filter after the DFE in order to whiten the error sequence. The ISI 
introduced into the data symbol stream by this filter is then compensated in the trellis decoder 
10 by the use of delayed decision feedback sequence estimation (DDFSE) as described in 

"Delayed decision-feedback sequence estimation," by A. Duel-Hallen and C. Heegard, IEEE 
Trans. Commun., vol. COM-37, no. 5, pp. 428-436, May 1989. 

The invention has applications in any trellis coded system that utilizes a DFE 
for equalization, especially in cases where the SER after the equalizer is high and error 
15 propagation causes problems. An example is terrestrial transmission of digital TV signals. 

The invention can also be used in trellis coded systems with DFEs which are 
subject to colored noise interference. Again, the DFE cancels much of the interference but the 
adaptive predictor serves to whiten the noise further. This helps improve the trellis decoder 
performance. 

20 The invention accordingly comprises the several steps and the relation of one or 

more of such steps with respect to each of the others, and the apparatus embodying features of 
construction, combinations of elements and arrangement of parts which are adapted to effect 
such steps, all as exemplified in the following detailed disclosure, and the scope of the 
invention will be indicated in the claims. 

25 

BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the invention reference will be had to the 
following drawings: 

Figure 1 shows a standard DFE; 
30 Figure 2 shows a DFE in accordance with the invention; and 

Figure 3 shows a DFE in accordance with the invention during a training 

sequence. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Figure 1 is a diagram of the standard decision feedback equalizer 10 (DFE). 
The DFE includes a forward filter 12, a slicer 14, a feedback filter 16 and a subtracter 18. Let 
a* be the transmitted trellis-coded symbol stream. The received signal rk after multi-path 
5 distortion and added noise nk can be written as 

where h i9 i=0... L h -1 is the multipath channel of length l h and delay dh, and nk is the additive 
noise which in general is neither gaussian nor white. The forward filter 12 is used to remove 
the pre echo or ghosts in the received signal. The slicer 14 quantizes the signal a to the nearest 
10 symbol a k . If an error is made in this quantization the error is passed to the feedback filter 16 
and remains in the system. The output of the feedback filter 16 is subtracted from the output 
of the forward filter 12 to provide a^. 5k is an estimate of the transmitted symbol ak plus, an 
error e k . It can also be expressed as: 
u 

°k = £ /, n+ df 1, + X bi Ek^i (2) 

15 where fj, i=0... Lr 1 are the forward equalizer taps, bj, i=l ... Lb are the feedback taps, df is the 
delay through the forward equalizer, db is the delay in the feedback equalizer and a k is the 
constellation point closet to 5 k . In the absence of error propagation, i.e. if a k = a k , the error 
sequence ek at the equalizer output 20 is white. However, in most cases the error propagation 
causes this error sequence to be correlated, that is, the noise samples are no longer 

20 independent The "colored" noise affects the performance of a trellis coder, because a trellis 
coder is optimized for performance in a channel having all white guassian noise. 

In accordance with the invention, as shown in Fig. 2, an adaptive filter 22 is 
placed at the output of the DFE 10 but before a trellis decoder (not shown). The output of 
filter 22 can be expressed as 

25 + £ ft '« (3) 

where (1, gi, g2, g3-..gLg) are the taps of the adaptive filter. Since a k = a k + ek, then the adaptive 
filter output can be written as 

Vk = a* + Z 2/ fl * + < + * Z Si (4) 

It 

= ak + ^Stak+i + e'k 




WO 00/01085 PCT/IB99/01087 

4 

If the filter taps are chosen so as to minimize the variance of e k , the SNR of the sequence y k 
can be improved. In addition, since e' k is the prediction error sequence of the equalizer output 
error sequence ejc, it will be white see Widrow and Steams, "Adaptive Signal Processing," 
(hereby incorporated by reference), at pages 99-1 1 6), which does not affect the performance of 
5 a trellis decoder. 

Training of the Adaptive Filter 

To minimize the error from the output of the DFE, or in other words to tune the 
adaptive filter taps g to the error e^, the adaptive filter 22 is first placed through a training 

10 sequence as shown in Fig. 3. In many applications, such as digital TV, the training sequence 
is part of the transmitted signal. After the equalizer 10 has converged (via blind means, 
without using the signal a^ or trained means which uses the signal a k ) the adaptive filter 22 
receives a training sequence which is the difference between the output of the DFE a k and the 
transmitted symbol sequence a k . This difference is the error eic produced by the DFE. 

15 a-a k = ek (5) 
This error sequence ejc is then input into the adaptive filter 22. The adaptive filter 22 forms an 
output sequence x k as shown in Fig. 3, where 

Xk = e k + Yi8i e " ( 6 ) 

The filter taps g k are adapted using the LMS algorithm as follows 
20 g(k + l) = g(k)- MXk e(k) (7) 

where g = and e(k) = e^i , e^, ... e^g]. This adaptation adapts the filter taps to minimize the 
mean squared, error ek 2 , of the DFE. 

Since the trellis decoder uses the taps [g u g 2 , ... g Lg ] in a feedback loop, error 
propagation can also occur hence it is also beneficial to limit the size of the taps g during 
25 adaptation, so that the trellis decoder that uses these taps does not suffer error propagation. If 
g is too small, however, the efficiency of the adaptive filter is reduced. Accordingly, an 
additional power constraint is imposed on the LMS algorithm to limit the amplitude of the taps 
which reduces the error propagation in the DDFSE trellis decoder (described next). A 
parameter P is chosen such that it is required that 

30 tg 2 <P (8) 

M 1 
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At each step of the LMS algorithm this condition is tested, and if violated, the taps are rescaled 
appropriately. 

The Adaptive Filter and DDFSE 
5 Once the adaptive filter 22 is appropriately trained to minimize ek, a^ = ak + ek 

is input to the adaptive filter 22. The adaptive filter 22 although it has been trained to 
minimize ek, it will also distort S k . Equation 9 shows this distortion and represents the output 
of adaptive filter 22 as follows: 

i m i 

10 As stated above, if the filter taps g are chosen to minimize ek, the SNR of the sequence y k can 
be improved. y k , however, is a distorted Sk and includes the ISI introduced into the data 
stream by the adaptive filter 22. This distortion is then compensated for in the trellis decoder 
by use of delayed decision feedback sequence estimation (DDFSE)as described in A. Duel- 
Hallen and C. Heegard, "Delayed decision-feedback Sequence Estimation," IEEE Trans. 

1 5 Common., Vol. Com - 37, no. 5, pp. 428-436, May 1 989, hereby incorporated by reference, 
and as summarized below. 

From the definition of y k , we see that an optimum trellis decoder which will 
remove the distortion of 5k, should minimize the metric (maximum likelihood decoding): 



it 



>i 



(10) 



20 This equation, however, requires past symbol sequences au to be saved, and each tap gj in the 
adaptive filter therefore introduces more memory into the system which causes the number of 
steps of a trellis decoder to grow exponentially with the number of taps in the adaptive filter 
22. Therefore an expanded trellis is necessary to accommodate the memory (a k -0 introduced 
by the adaptive filter 22. 

25 A suboptimum, but computationally less intensive way of performing the trellis 

decoding is to instead minimize the following metric: 

(11) 



where the sequence ak-i,j, i=l, ... L g is the survivor symbol sequence associated with state j in 
the trellis. This scheme does not expand the number of states in the original trellis, but instead 
30 introduces decision-feedback in each of the trellis states. That is, since this scheme uses a k .j, 
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which is merely an estimate of, rather than the actual value a k -i, there is no memory introduced 
into the system. Since there is no memory, an expanded trellis is not required, i.e. the number 
of states in the trellis remains the same even with the additional adaptive filter 22. 

There is the possibility of error propagation in this implementation and hence 
5 the precaution is taken in the LMS algorithm of limiting the amplitude of the filter taps. The 
optimum value of P will depend on the trellis code and application. In the United States 
HDTV example, simulation results indicate that a value of P=0.15 gives good performance. 

It will thus be seen that the objects set forth above, among those made apparent 
from the preceding description, are efficiently attained and, since certain changes may be 
10 made in carrying out the above method and in the construction set forth without departing 
from the spirit and scope of the invention, it is intended that all matter contained in the above 
description and shown in the accompanying drawings shall be interpreted as illustrative and 
not in a limiting sense. 
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CLAIMS: 



1 . A decision feedback equalizer, (DFE) comprising: 

an input which receives an input signal comprising, a transmitted symbol stream, noise and 
multipath; 

5 a DFE output which provides a DFE output signal (a^; 

a forward filter (12) which filters the input signal; 
a decision feedback loop comprising a subtracter (1 8), a slicer (14), and a 
feedback filter (16), wherein the subtracter (18) is coupled to both an output of the forward 
filter (12) and an output of the feedback filter (16) and subtracts the output of the feedback 
10 filter (16) from the output of the forward filter (12) to provide the DFE output signal (5k) 
which is applied to an input of the slicer (14); and 

an adaptive filter (22), coupled to the DFE output, to adaptively filter the DFE 
output, and whiten an error in the DFE output signal. 

15 2. The DFE as claimed in claim 1 , further including a training device which trains 

the adaptive filter to minimize the mean squared error in the DFE output. 

3. A device for improving DFE performance, comprising: 
an input which receives an output of a DFE; 

20 an adaptive filter (22) having an adaptive filter input and an adaptive filter 

output, the adaptive filter input coupled to the input; and 

an output coupled to the adaptive filter output for supplying an output signal to 
a DDFSE trellis decoder, which output signal is the DFE output signal with a smaller whiter 
error than the error in the output of the DFE. 

25 

4. The device as claimed in claim 3, wherein the adaptive filter (22) is adapted to 
receive a training sequence that adapts filter taps (gi ... gi g .t) in the adaptive filter such that the 
adaptive filter (22) acts to whiten the error in the output of the DFE (5k). 
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5/ The device as claimed in claim 4, wherein the adaptive filter (22) further 

includes a LMS algorithm which is used to adapt the filter taps. 

6. The device as claimed in claim 5, wherein the adaptive filter further includes a 

5 device for comparing 



L * 2 

Ys.<P (Ha) 



where gj is a filter tap and P is a power constraint imposed on the LMS algorithm to limit 
1 0 amplitude of the filter taps. 

7. A method of improving DFE performance, comprising the steps of: 
receiving an output signal from the DFE which includes 

a k + e k ; 

1 5 adapti vely filtering a k + e k ; 

providing the adaptively filtered a k + e k to a DDFSE. 

8. A method of decision feedback equalizing, comprising the steps of: 
receiving an input signal comprising a plurality of symbols, noise and 

20 multipath; 

forward filtering the received signal using a forward filter having a plurality of 

taps; 

subtracting from the forward filtered signal a feedback filtered signal to provide 
a decision feedback output; 
25 quantizing the decision feedback output to the nearest symbol to provide a 

quantized output; 

feedback filtering the quantized output to provide the feedback- filtered signal; 

and 

adaptively filtering the decision feedback output. 

30 

9. A DFE, comprising: 

a forward filter (12), having an input which receives an input signal and a 
forward filter output; 



<9 • 
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a subtractor (1 8) having a first input coupled to the forward filter output and 
having a second input and a subtractor output; 

a sheer (14)having an input coupled to the output of the subtractor and a slicer 

output; 

5 a feedback filter (16) coupled to the sheer output and the second input of the 

subtractor; and 

an adaptive filter (22) coupled to the output of the subtractor. 

10. A television receiver, including a DFE, comprising: 

10 a forward filter (12), having an input for receiving an input signal and a forward 

filter output; 

a subtractor (1 8) having a first input coupled to the forward filter output and 
having a second input and a subtractor output; 

a sheer (14) having an input coupled to the output of the subtractor and a slicer 

15 output; 

a feedback filter (16) coupled to the slicer output and the second input of the 

subtractor, 

an adaptive filter (22) having an input coupled to the output of the subtractor 
and an adaptive filter output; and 
20 a DDFSE having an input coupled to an output of the adaptive filter. 

11. A device for improving DFE performance, comprising: 

DFE means (12,18,14,16) having an input and an output for providing a DFE 
output signal; and 

25 adaptive filter means (22) coupled to the output of the DFE for adaptively 

filtering the DFE output signal and thereby whitening noise in the DFE output signal. 
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(57) Abstract 



A method and device for improving DFE performance in a trellis coded system by placing a short adaptive predictive filter after the 
DFE in order to whiten the error sequence at the output of the DFE. 
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